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Abstract 

Background: Scientific evidence supports decision-making on the use of implantable medical devices (IMDs) in 
clinical practice, but IMDs are thought to be far less investigated than drugs. In the USA, studies have shown that 
approval process of high-risk medical devices was often based on insufficiently robust studies, suggesting that 
evidence prior to marketing may not be adequate. This study aimed to ascertain level of evidence available for 
IMDs access to reimbursement in France. 

Methods: The objective was to examine the scientific evidence used for IMDs assessment by the French National 
Authority for Health. We collected all public documents summarising supportive clinical data and opinions 
concerning IMDs issued in 2008. An opinion qualifies the expected benefit (EB) of the IMD assessed as sufficient or 
insufficient, and if sufficient, the level of improvement of the expected benefit (IEB) on a scale from major (level I) 
to no improvement (level V). For each opinion, the study with the highest level of evidence of efficacy data, and its 
design were collected, or, where no studies were available, any other data sources used to establish the opinion. 

Results: One hundred and two opinions were analysed, with 72 reporting at least one study used for assessment 
(70.6%). When considering the study with the highest level of evidence: 34 were clinical non-comparative studies 
(47.2%); 29 were clinical comparative studies of which 25 randomised controlled trials (40.3%); 5 were meta-analyses 
of randomised controlled trials (6.9%); and 4 were systematic literature reviews (5.6%). The opinions were 
significantly different according to the study design (p< 0.001). The most frequent design for insufficient EB, IEB 
level V and IEB level IV was a non-comparative study (10/19, 52.6%; 15/24, 62.5%; and 8/15, 53.3%; respectively). For 
the 30 opinions with no supporting clinical study, 16 (53.3%) were based on an expert-based process, 9 (30.0%) 
were based on the conclusions of a previous opinion (all concluding IEB level V), and 5 (16.7%) reported no data 
(concluding insufficient EB for 4 and IEB level V for 1). 

Conclusions: This study confirmed that level of evidence of clinical evaluation of IMDs is low and needs to be 
improved. 
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Background 

By the late 1990s, the US Food and Drug Administration 
(FDA) had given marketing approval to around 500,000 
medical devices, produced by approximately 23,000 dif- 
ferent manufacturers, and it has been estimated that 4% 
of the US population has at least one implanted medical 
device [1,2]. The US medical device market was esti- 
mated in 2011 at US$105.8 billion. In Europe, there 
are almost 22,500 medical technology firms, which 
generate annual sales of €95 billion [3], In 2006, the 
medical device market in France comprised €19 billion 
in sales, representing 12% of medical and health care 
consumption [4]. 

Most new medical technologies are intended to im- 
prove quality of care but they also increase health spend- 
ing [5]. For this reason Health Technology Assessment 
(HTA), which is defined as the systematic evaluation of 
the properties, effects, and/or impacts of healthcare 
technology [6], has been developed to inform healthcare 
providers, payers and patients about technology-related 
clinical and cost effectiveness. In France, the government 
set up the French National Authority for Health (Haute 
Autorite de Sante, HAS) in August 2004, whose activities 
are designed to improve the quality of patient care and 
guarantee equity within the healthcare system. These ac- 
tivities include the assessment of medical devices based 
on scientific expertise, carried out by a dedicated com- 
mittee (Commission Nationale d'Evaluation des Disposi- 
tifs Medicaux et Technologies de Sante, CNEDIMTS) [7]. 
The aim of these assessments is to provide "opinions" to 
health authorities that contain the information needed 
to support decisions regarding the reimbursement. All 
assessed medical devices qualified with "sufficient 
expected clinical benefit" are included on the list of pro- 
ducts and services qualifying for reimbursement [8]. 

In this context, a manufacturer who seeks reimburse- 
ment by the French Health Insurance system for the cost 
of a medical device has two options. If the medical de- 
vice responds to a generic definition already included on 
the list qualifying for reimbursement, it can be registered 
directly. In case there is no generic definition for the 
medical device, the manufacturer has to apply for spe- 
cific CNEDIMTS' assessment (brand name registration), 
and to submit a dossier containing clinical data. These 
data should demonstrate the value of the medical device, 
i.e. what is the expected clinical benefit and whether it is 
sufficient to justify its inclusion on the list qualifying for 
reimbursement, and should propose what improvement 
in terms of clinical benefit may be expected in compari- 
son with the existing standard of care. The CNEDIMTS' 
members base their scientific assessment on the synthe- 
sis of information performed by internal assessors, from 
clinical data provided by the manufacturers or retrieved 
from an in-house scientific literature search. They focus 



specifically on the following features of studies: meth- 
odological quality; selection of a relevant population; 
main outcome measure; and adverse events and compli- 
cations related to the procedure. For every assessment, a 
public document summarising supportive clinical data 
and providing the opinion is available on the French Na- 
tional Authority for Health's website [7] . 

Previous studies have shown that the approval process 
for high-risk medical devices in the USA is often based 
on insufficiently robust studies, suggesting that evidence 
prior to marketing may not be adequate [9,10]. This 
study aimed to ascertain what level of evidence was 
available for IMDs access to reimbursement in France. 
Therefore, we have described the scientific evidence, in 
terms of the methodology and characteristics of the clin- 
ical studies used by CNEDIMTS for implantable medical 
device assessment, after marketing but prior to the deci- 
sion on reimbursement. 

Methods 

Opinions 

An opinion is the result of CNEDIMTS assessment of 
safety and efficacy of a device in a specified indication, 
expressed by the qualification of its "expected benefit" 
(EB) as insufficient or sufficient; in the latter case its 
"improvement of expected benefit" (IEB) level is docu- 
mented. EB is a multifactor criterion based on expertise 
of clinical benefit, efficacy/safety ratio, and public health 
benefit. IEB is given in comparison to the established 
standard of care: level I means there is a major improve- 
ment in expected benefit with the IMD; level II is a 
significant improvement; level III is a moderate im- 
provement; level IV is a minor improvement; and level 
V is no improvement. An IMD could be used in differ- 
ent indications, resulting in one opinion for each indica- 
tion. Therefore there could be more opinions than 
devices; the statistical unit for this study was one 
opinion, given for one IMD used for one precise clinical 
indication. 

Opinions can be issued for a new application (first or 
subsequent), a modification, or a renewal. A "new appli- 
cation" was considered as "first", only for the first appli- 
cation, and as "subsequent" when re-application was due 
to a previous insufficient EB opinion. After the IMD is 
included on the list, each modification (e.g. restriction of 
use or indication) must be assessed by CNEDIMTS. 
Every 5 years (maximum) after inclusion on the list, a re- 
newal application must be submitted, leading to assess 
the observed benefit and the improvement of observed 
benefit. For convenience, EB will refer to both expected 
(new application) and observed (renewal application) 
benefit. 

Public documents presenting opinions summarise in- 
formation on clinical data: the number of studies 
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provided by the applicant, the number of studies 
selected by CNEDIMTS for the assessment process, and 
the abstract outlining the main characteristics of selected 
studies (design, number of patients, results). Supporting 
clinical data are specific or non-specific to the device 
assessed. Non-specific data relating to the device come 
from studies performed on an equivalent medical device 
(same technological characteristics and same intended 
use) i.e. previous model or device manufactured by a 
competitor. 

Search and opinion selection 

The present study included all opinions concerning 
IMDs issued by the CNEDIMTS in 2008 and publicly 
available on the website of the French National Author- 
ity for Health (http://www.has-sante.fr). 

Data collection 

For each opinion, two reviewers (LH and ED) independ- 
ently examined and collected the data using predefined 
case report forms. Discrepancies between the two 
reviewers were resolved by consensus. 

Study selection within opinions Only studies reporting 
efficacy were examined. For modification or renewal 
applications, only the new clinical data, i.e. that became 
available since the previous opinion, were considered. 
The reviewers extracted the number of studies: i) pro- 
vided by the manufacturer (when explicitly provided); 
and ii) selected by CNEDIMTS (including those from 
manufacturer and those from the in-house literature 
search) as mentioned in its opinion. 

Among the studies selected by CNEDIMTS, the one 
presenting the highest level of evidence was chosen for 
methodological description, whether it was specific or 
non-specific to the device. The levels of evidence of the 
studies were defined as follows (from the highest to the 
lowest [11]): 1) meta-analysis of randomised controlled 
trials (RCTs); 2) RCTs; 3) non-randomised comparative 
studies; 4) non-comparative studies i.e. meta-analysis of 
non-comparative studies, prospective observational 
registries, prospective case-series, and retrospective 
case-series. Systematic literature reviews were consid- 
ered if no specific study was available. When two studies 
had the same level of evidence, the one with the highest 
number of patients was analysed. 

Data items The following general information was 
extracted: the date of the opinion; the year of the CE 
marking (Conformite Europeenne); the type of applica- 
tion i.e. new application (first or subsequent), modifica- 
tion, or renewal; the date of previous opinion if relevant; 
and the opinion result i.e. EB qualification (sufficient or 
insufficient) and IEB level. 



The following main methodological characteristics of 
the highest level of evidence studies, as available in pub- 
lic documents, were collected: 

- number of centres (single centre, national 
multicentre, and international multicentre); 

- study design (as described above); 

- total number of patients included in statistical 
analysis; 

- output (statistical significance of the main result). 

When no studies had been retained as scientifically 
sound by the CNEDIMTS, we collected the other 
sources of data (if any) used to provide the opinion. 

Data analysis 

The categorical variables were described as frequencies 
and percentages, and the continuous variables as average 
or median and range (minimum and maximum). For 
analysis, we considered a variable "EB + IEB" defined 
with 6 categories: insufficient EB, IEB level V, IEB level 
IV, IEB level III, IEB level II, and IEB level I. Types of 
application and collected studies characteristics were 
cross -tabulated with the results of the opinions (EB + 
IEB), and types of application were cross-tabulated with 
study design. Fisher exact tests were used. All data ana- 
lyses were performed using SAS version 9.2 (SAS Insti- 
tute Inc, Cary, NC). 

Results 

Description of opinions 

A total of 171 public documents were issued by the 
CNEDIMTS for medical devices in 2008; 83 concerning 
93 IMDs were included in the analysis (Figure 1), repre- 
senting 102 opinions. 

Seventy-nine opinions (77.5%) resulted in sufficient EB 
(Table 1). One IEB level I was observed (deep brain 
stimulation medical device). 

Sixty-six percent of the opinions resulted from new 
applications (67/102). The opinions were issued a me- 
dian of 5.0 years after the CE marking for first new 
applications (range: 0.0 to 12.0). Concerning subsequent 
new applications, the new opinion was given a median 
of 4.4 years after the previous application (range: 2.9 to 
6.1). Opinions concerning renewals were given after a 
median of 3.0 years following the previous one (range: 
1.5 to 6.0). 

EB + IEB differed according to the type of application 
(p = 0.002). Of the 23 opinions with insufficient EB, 21 
were new applications (91.3%). 

Description of clinical data 

For 70/102 opinions (68.6%), at least one clinical study 
was provided by the applicant, with an average number 
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Search 

Website of the French National Authority for 
Health 

Medical devices only 

Date of the public report between January 1, 
2008 and December 31, 2008 



Public documents 
(n = 171) 



Public documents screened on basis of the type of 
medical device and the presence of an opinion 



Included 

(n=83 public documents), 
representing 102 opinions 



Excluded (n=88) 

Non-implantable medical devices: 69 
IMDs public documents with no 
opinion: 18 

Duplicate of IMD public document: 1 



Figure 1 Flow diagram of opinion selection. 



of studies provided of 3.4 in these cases (the precise 
number of studies provided was available for 54 opi- 
nions; median: 2, range: 1 to 15). The CNEDIMTS ana- 
lysed clinical studies in 72/102 opinions (70.6%), with an 
average of 3.2 selected and analysed studies (median: 2, 
range: 1 to 15). 

Among these, the study with the highest level of evi- 
dence concerned the relevant medical device in 45/72 
studies (62.5%), a previous model 15/72 (20.8%) and a 
similar model in 12/72 (16.7%). 

The main methodological characteristics of these stud- 
ies are shown in Table 2. 

The study design was significantly different according 
to EB + IEB (p < 0.001). The most frequent design was 
non-comparative studies for insufficient EB (10/19; 
52.6%), IEB level V (15/24; 62.5%) and IEB level IV (8/ 
15; 53.3%); randomised controlled trials for IEB level III 



(3/5; 60.0%) and IEB level I (1/1); and meta-analysis for 
IEB level II (5/8; 62.5%). 

The study design was significantly different according 
to the type of application (p = 0.006), e.g., for the 45 new 
applications, there were 24 non-comparative studies 
(53.3%) compared with 5 for the 18 renewals (27.8%). 

For the 30 opinions with no supporting clinical study, 
16 (53.3%) were based on CNEDIMTS expert-based ana- 
lysis (involving multidisciplinary working group using 
medical device group information: literature analysis and/ 
or previous opinions): 12 concerned implantable cardiac 
defibrillators; three prosthetic meshes for hernia repair; 
and one a triple-chamber pacemaker. All concluded with 
IEB level V. Nine opinions (30.0%) were based on the con- 
clusions of a previous opinion (all concluded with IEB 
level V). The last 5 opinions reported no data and con- 
cluded with insufficient EB for 4, and IEB level V for 1. 



Table 1 Distribution of the Expected Benefit and Improvement of Expected Benefit level according to the type of 
application 





Total N (%) 


New N (%) 


Modification N (%) 


Renewal N (%) 


Sufficient EB* 


79 (77.5) 


46 (68.7) 


13 (92.9) 


20 (95.2) 


IEB f level 1 


/ (10) 


0 (0.0) 


/ (7.1) 


0 (0.0) 


IEB level II 


8 (7.8) 


2 (3.0) 


0 (0.0) 


6 (28.6) 


IEB level III 


5 (4.9) 


3 (4.5) 


/ (7.1) 


/ (4.8) 


IEB level IV 


15 (14.7) 


1 1 (16.4) 


/ (7.1) 


3 (14.3) 


IEB level V 


50 (49.0) 


30 (44.8) 


10 (71.4) 


10 (47.6) 


nsufficient EB 


23 (22.5) 


21 (31.3) 


1 (7.1) 


1 (4.8) 


Total 


102 


67 


14 


21 



* EB: expected benefit. 

f IEB: improvement of expected benefit. 
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Table 2 Description of methodological characteristics of the highest level of evidence studies considered for 
assessment of implantable medical devices (one study analysed per opinion) 



Overall 

N (%) 



Sufficient Expected Benefit (EB* 



IEB* I IEB I 



IEB III 



IEB IV 



IEB V 



Insufficient 
EB 



Number of centres 1 

Single centre 12(19.7) 0 0 

National multicentre 16(26.2) 0 1 

nternational multicentre 12(19.7) 1 0 

Not known 21 (34.4) 0 2 
Design 

Meta-analysis of RCTs* 5 (6.9) 0 5 

RCTs 25 (34.7) 1 3 

Comparative non-randomised study 4 (5.6) 0 0 

Non-comparative study 34 (47.2) 0 0 

Retrospective case series 5 (14.7) 0 0 

Prospective cohort 21(61.8) 0 0 

Observational registry 6 (17.6) 0 0 

Meta-analysis of non comparative study 2(5.9) 0 0 

Systematic literature review 4 (5.6) 0 0 
Number of patients 8 
(median (range)) 
Output 

Significant result 21 (70.0) 1 8 

Insignificant result 9 (30.0) 0 0 

Total 72(100.0) 1 8 



3 
1 

75 



4 
4 
24 



127.5 (8-18 023) 40 (.) 530 (22-18 023) 568.5 (8-1065) 67 (15-859) 198(29-8 318) 62 (19-280) 



3 
3 

79 



* EB: expected benefit; IEB: improvement in expected benefit. 

f Non-applicable for 1 1 studies (meta-analysis and systematic literature reviews). 

* RCTs: randomised controlled trials. 

55 Non-applicable for systematic literature reviews. 

" For comparative studies and meta-analyses of RCTs only; for 4 the information is missing. 



Discussion 

In 2008, among the clinical studies with the highest 
level of evidence assessed by CNEDIMTS, less than 
half were RCTs or meta-analysis of RCTs. The EB for 
the CNEDIMTS' opinions on IMDs correlated to the 
clinical studies' level of evidence: low levels of evi- 
dence were observed in insufficient EB or low levels 
of IEB. When no clinical data was available for assess- 
ment, the opinion was more likely to conclude on in- 
sufficient EB. 

To our knowledge, this study is the first to provide a 
description of the methodological characteristics of stud- 
ies used during medical device assessment by the French 
National Authority for Health, and one of the first 
assessments of the decisions issued by a national compe- 
tent authority. Its main limitation is the use of publicly 
available opinions as a data source: some data may have 
been omitted from public documents, as the opinions do 
not reveal the complexity of the committee's decision- 
making process. 



The level of evidence of the clinical studies carried out 
is expected to impact coverage and reimbursement 
determinations, which indirectly impacts the diffusion of 
implantable medical devices in healthcare practices. This 
issue is complicated for manufacturers, who argue that 
increasing the level of evidence required will create a fi- 
nancial and time barrier to putting new products on the 
market and restrict patients' access to new medical tech- 
nologies [12,13]. This is even more difficult for smaller 
firms, which represent most of medical technology 
firms, which may not have the capital to conduct trials 
and are not equipped to meet regulatory and methodo- 
logical requirements [14]. 

In Europe, studies assessing the clinical efficacy of 
implantable medical devices were not systematically 
required for CE marking until the 2007 European Dir- 
ective [15]. The regulatory approval for CE marking fo- 
cuses on safety, device quality and performance. Very 
often only scarce information is available when a new 
medical device first comes onto the market. Indeed, 
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methodological issues are encountered when designing a 
clinical study for medical devices evaluation [16]. RCTs, 
commonly used in drug development and considered to 
be the study design which provides the highest level of 
evidence for assessing the efficacy of health products, 
are particularly prone to methodological challenges 
when considering IMDs [17]. Blinding is not always feas- 
ible (or unethical, for instance sham surgery). Interaction 
between device and operator might induce heterogeneity 
in clinical efficacy and safety, such as learning curve ef- 
fect, teams' expertise and habits (need for procedure 
standardisation), or continuous technological evolution. 
Inclusions in such studies might be difficult, since target 
populations are often small. 

In the USA, the safety and effectiveness of high-risk 
medical devices, such as implantable medical devices, 
are assessed by the FDA during the Premarket Approval 
(PMA) process which relies on clinical data. Two studies 
have shown that PMA for cardiovascular devices be- 
tween 2000 and 2007 was often based on studies which 
were insufficiently robust and possibly prone to bias, as 
only 27% of studies used to support PMA were rando- 
mised [9,10]. Furthermore, 65% of PMAs were based on 
a single study, suggesting that there may not be adequate 
evidence prior to marketing [9]. Even if most Class III 
devices should require PMA, it has been discussed that 
a large percentage avoid this process and go through 
510(k) submission, which is known to be less rigorous 
with no systematic need for supportive clinical evidence 
[18]. In 2003-2007 fiscal years, 228 Class III devices 
had been cleared by FDA through 510(k) process, while 
217 had been submitted through original PMA [19]. 

We showed that a new opinion was given up to 
12 years after CE marking. During this time, a new de- 
vice may be distributed and widely used by physicians in 
their standard practice of care, especially in the case of 
innovative devices [20]. Once the medical device has 
been distributed, it becomes difficult to assess its clinical 
benefit and cost in relation to existing strategies [21]. 
The main constraint in performing RCTs after device 
distribution is that randomisation may not be accepted, 
not only by physicians, but also by patients who are well 
informed about new technologies and are keen to access 
them. Therefore, to determine efficacy and safety, alter- 
native approaches to conventional trial designs might be 
considered, e.g. use of historical controls and acceptance 
of p values greater than 0.05 [22]. It has also been sug- 
gested that well-designed comparative observational 
studies may provide information for clinical and effect- 
iveness assessments [23-25]. Such studies may be per- 
formed within a post-marketing surveillance program. In 
first place, post-marketing surveillance has been set up 
to explore safety concerns such as rare adverse events, 
through vigilance reporting. However, specific post- 



marketing clinical studies have to be developed as they 
can offer the opportunity to collect outcomes data [26], 
not only for safety but for efficacy purpose. It has been 
suggested for high-risk medical devices that a post- 
marketing surveillance program should be in place at 
the time of market authorisation as a continuum of clin- 
ical studies from pre-market to routine use, within a 
new regulatory approach [27]. A new model based on 
temporary authorisations and post-marketing studies 
could be developed. Currently, post market registries are 
being increasingly set up to provide real life data about 
use, safety and efficacy of IMDs. 

HTA for medical devices can guide collective choices 
in terms of access to technology, with a view to ensuring 
their effectiveness and cost-effectiveness. The lack of sci- 
entific data raises ethical issues as offering a new, un- 
approved technique outside of a clinical research 
context may put the patient at risk. The timely diffusion 
of such techniques is vital as there are risks associated 
with the premature introduction of a device without suf- 
ficient clinical evaluation, just as an excessive waiting 
period may be detrimental to patients. There is a serious 
question as to when the assessment should be carried 
out: if it is done early in the development process, both 
the device and procedure may undergo changes and the 
learning curve effect has to be incorporated, and the 
findings of the assessment may rapidly become obsolete 
[28]. Procedures to ensure the "safe" diffusion of innova- 
tions has been implemented in European countries as 
programmes for funding innovation under the frame- 
work of clinical research. A programme to support in- 
novative and costly technologies was created in the early 
2000s by the French Ministry of Health, with the aim of 
supervising their diffusion whilst simultaneously asses- 
sing their clinical and cost effectiveness. In the United 
Kingdom, a procedure for temporary reimbursement has 
been set up for innovative devices when used only in re- 
search for the purposes of generating clinical data and 
good practice guidelines [29]. 

Conclusions 

This study confirmed that level of evidence of clinical 
evaluation of IMDs is low and needs to be improved, 
since less than half of clinical studies with the highest 
level of evidence assessed by CNEDIMTS in 2008 were 
RCTs or meta-analysis of RCTs. Future work should de- 
sign new recommendations in this field by investigating 
the determinants and the solutions needed to improve 
quality of clinical evaluation of medical devices, in con- 
nection with small and medium firms, clinicians and 
authorities. 

Abbreviations 

CNEDIMTS: Commission Nationale d'Evaluation des Dispositifs Medicaux et 
Technologies de Sante; EB: Expected benefit; FDA: Food and Drug 



Huot ef al. BMC Public Health 201 2, 1 2:585 Page 7 of 7 

http://www.biomedcentral.com/1471-2458/12/585 



Administration; HAS: Haute Autorite de Sante; HTA: Health technology 
assessment; IEB: Improvement in expected benefit; IMD: Implantable Medical 
Device; PMA: Premarketing authorisation; RCT: Randomized controlled trial. 

Competing interests 

The authors declare that they have no competing interests. 
Authors' contributions 

LH designed the study, examined, collected and managed the data, 
interpreted data and drafted the manuscript. ED participated in the design 
of the study, examined and collected the data, did the statistical analysis, 
and helped to draft the manuscript. KMB participated in the design of the 
study and the collection of data. FC participated in the design of the study, 
and helped to draft the manuscript. All of the authors read and approved 
the final manuscript. 

Acknowledgements 

We thank Kim Barrett, Version Originale, for her help with the English version. 
There was no funding source. 

Author details 

'Hospices Civils de Lyon, Pole Information Medicale Evaluation Recherche, 
Unite de Recherche Clinique, Lyon 69003, France. 2 Universite de Lyon, REQF, 
EA Sante Individu Societe 4129, Lyon 69003, France. 3 Universite Lyon 1, Lyon 
69003, France. Conference Nationale des Comites de Protection des 
Personnes dans la recherche biomedicale, Comite de Protection des 
Personnes Sud-Est III, Lyon 69003, France. 

Received: 26 October 201 1 Accepted: 15 June 2012 
Published: 1 August 2012 

References 

1 . (vlaisel WH: Medical device regulation: an introduction for the practicing 
physician. Ann Intern Med 2004, 140(4):296-302. 

2. Monsein LH: Primer on medical device regulation. Part I. History and 
background. Radiology 1997, 205(l):l-9. 

3. EUCOMED: Eucomed data supplies, http://www.eucomed.org/medical- 
technology. 

4. Haut Conseil pour I'Avenir de I'Assurance Maladie: Note sur les Dispositifs 
Medicaux. http://www.securite-sociale.fr/institutions/hcaam/avis/ 
hcaam_note_290508.pdf. 

5. Fuchs VR: New priorities for future biomedical innovations. N Engl J Med 
2010, 363(8):704-706. 

6. INAHTA: International Network of Agencies for Health Technology Assessment 
(INAHTA): Health Technology Assessment Glossary. 2006. http://www.inahta. 
org/HTA/Glossary/#_G. 

7. Haute Autorite de Sante. http://www.has-sante.fr/portail/jcms/c_5443/ 
english?cid=c_5443]. 

8. Code de la Securite Sociale: Article L 165-1. Current to July 23, 2009. http:// 
www.legifrance.gouv.fr. 

9. Dhruva SS, Bero LA, Redberg RF: Strength of study evidence examined by 
the FDA in premarket approval of cardiovascular devices. Jama 2009, 
302(24)2679-2685. 

10. Kramer DB, Mallis E, Zuckerman BD, Zimmerman BA, Maisel WH: Premarket 
clinical evaluation of novel cardiovascular devices: quality analysis of 
premarket clinical studies submitted to the Food and Drug 
Administration 2000-2007. Am J Ther 2010, 17(1)2-7. 

1 1. Agence Nationale d'Accreditation et d'Evaluation en Sante: Guide d'analyse 
de la litterature et gradation des recommandations. 2000. http://www.has- 
sante.fr/portail/upload/docs/application/pdf/analiterat.pdf. 

12. Reed SD, Shea AM, Schulman KA: Economic implications of potential 
changes to regulatory and reimbursement policies for medical devices. 
J Gen Intern Med 2008, 23(Suppl l):50-56. 

1 3. EUCOMED: Eucomed HTA Position Paper. 2008 http://www.eucomed.org/ 
uploads/Modules/Publications/Eucomed%20position%20paper%20on% 
20Health%20Technology%20Assessment%20(HTA).pdf. 

14. Huot L, Decullier E, Aulagner G, Chapuis FR: Medical device evaluation: 
what are the needs? Presse Med 2010, 39(10):1 097-1 098. 

1 5. Directive 2007/47/EC of the European Parliament and of the Council of 5 
September 2007 amending Council Directive 90/385/EEC on the approximation 
of the laws of the Member States relating to active implantable medical 



devices, Council Directive 93/42/EEC concerning medical devices and Directive 
98/8/EC concerning the placing of biocidal products on the market. 2007. 
Official Journal of the European Union L 247 http://eur-lex.europa.eu/ 
LexUriServ/LexUriServ.do?uri=OJ:L:2007:247:0021:0055:en:PDF. 

16. Sedrakyan A, Marinac-Dabic D, Normand SL, Mushlin A, Gross T: A 
framework for evidence evaluation and methodological issues in 
implantable device studies. Med Care 2010, 48(6 Suppl):S121-S128. 

1 7. Ramsey SD, Luce BR, Deyo R, Franklin G: The limited state of technology 
assessment for medical devices: facing the issues. Am J Manag Care 1998, 
4SP188-SP199. 

18. Hines 17, Lurie P, Yu E, Wolfe S: Left to their own devices: breakdowns in 
United States medical device premarket review. PLoS Med 2010, 
7(7):el 000280. 

1 9. Garber AM: Modernizing device regulation. N Engl J Med 201 0, 
362(1 3):1 161-11 63. 

20. Wilson CB: Adoption of new surgical technology. BMJ 2006, 
332(7533):! 12-1 14. 

21 . Gabbay J, Walley T: Introducing new health interventions. BMJ 2006, 
332(7533):64-65. 

22. Konstam MA, Pina I, Lindenfeld J, Packer M: A device is not a drug. J Card 
Fail 2003, 9(3):155-157. 

23. Tunis SR, Stryer DB, Clancy CM: Practical clinical trials: increasing the value 
of clinical research for decision making in clinical and health policy. 
Jama 2003, 290(1 2):1 624-1 632. 

24. Black N: Why we need observational studies to evaluate the 
effectiveness of health care. BMJ 1 996, 31 2(7040):1 2 1 5-1 21 8. Clinical 
research ed. 

25. Concato J, Shah N, Horwitz Rl: Randomized, controlled trials, 
observational studies, and the hierarchy of research designs. N Engl J 
Med 2000, 342(25)1887-1892. 

26. Rao SV, Califf RM, Kramer JM, Peterson ED, Gross TP, Pepine CJ, Williams DO, 
Donohoe D, Waksman R, Mehran R, ef al: Postmarket evaluation of 
breakthrough technologies. Am Heart J 2008, 156(2)201-208. 

27. Mehran R, Leon MB, Feigal DA, Jefferys D, Simons M, Chronos N, FogartyTJ, 
Kuntz RE, Bairn DS, Kaplan AV: Post-market approval surveillance: a call for 
a more integrated and comprehensive approach. Circulation 2004, 
109(25)3073-3077. 

28. Raab GG, Parr DH: From medical invention to clinical practice: the 
reimbursement challenge facing new device procedures and 
technology-part 1: issues in medical device assessment. J Am Coll Radiol 
2006, 3(9):694-702. 

29. Dhalla IA, Garner S, Chalkidou K, Littlejohns P: Perspectives on the National 
Institute for Health and Clinical Excellence's recommendations to use 
health technologies only in research. Int J Technol Assess Health Care 2009, 
25(3):272-280. 



doi:1 0.1 1 86/1 471-2458-1 2-585 

Cite this article as: Huot ef al.: Medical device assessment: scientific 
evidence examined by the French national agency for health - a 
descriptive study. BMC Public Health 2012 12:585. 



Submit your next manuscript to BioMed Central 
and take full advantage of: 

• Convenient online submission 

• Thorough peer review 

• No space constraints or color figure charges 

• Immediate publication on acceptance 

• Inclusion in PubMed, CAS, Scopus and Google Scholar 

• Research which is freely available for redistribution 



Submit your manuscript at 
www. biomedcentra I .com/su bmit 



o 



BioMed Central 



